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;Uern,  I         finance  control  systems  re< 
of  the      :s  of  input  noise  and  dis        s.   Since  nc  . 

,oes  are  generally  random  in      e,  it  is  dif  Lcult  to  d 
with  time  functions.   Nevertheless,  such  inputs  can  very  often  b     -e- 
sented  by  other  mathematical  representations,  such  as  statistical  analysis. 
These  techniques  are  not  uncommon  in  linear  system  theory,  anu     as  ion  to 
nonlinear  systems  is  the  primary  object  of  this  report. 

VJhen  a  random  input  signal  to  a  nonlinear  control  s  it<   c<  n  be  tie- 
scribed  by  certain  types  of  statistical  functions,  a  method  of  analysis  may 
be  developed  for  the  nonlinear  systc...   In  the  development  of  the  method, 
the  criterion  for  design  is  restricted  to  the  minimization  of  the  mean  square 
or  root  mean  square  value  of  the  error  signal.   The  method  involves  replace- 
ment of  the  nonlinear  element  in  the  system  by  an  equivalent  device  whose 
describing  function  characteristics  are  a  functions  of  the  rms  signals  at 
the  input  of  nonlinear  element.   Two  methods  of  deriving  this  statistical 
describing  function  are  developed,  one  uses  an  analytical  mi  Limize 

the  system  error  signal  and  the  other  requires  the  determination  of  the 
output  probability  distribution  of  the  nonlinear  device  an  1  defines  the  ratio 
of  the  rms  value  of  the  output  distribution  to  the  rms  value  of  the  input 
distribution  as  the  statistical  describing  function.   Both  of  ci 
are  developed  for  simple  nonlinear  devices  in  which  the  output  is  a  function 
of  the  instantaneous  value  of  the  input,  therefore,  the  analysis  techniques 
of  linear  system  theory  can  be  made  applicable  with  only  slight  modification. 

One  matter  of  particular  interest,  the  analysis  of  jump  phenomenon,  is 


also  developed.  An  example  of  positioning  servomechanism  with  a  saturating 
amplifier  that  exhibits  the  jump  phenomenon  when  the  input  is  a  white  noise 
passing  through  the  lag  filter  is  presented. 

A  brief  discussion  of  the  fundamental  statistical  techniques  is  also 
given  in  order  to  provide  the  supporting  background  for  the  developement  of 
the  analysis  procedures. 


SOME  FUNDAMENTAL  CONCEPTS  OF  I    .  iLITY  THE' 

The  following  sections  present  a  brief  review  of  the  different  tools 
and  techniques  available  when  one  is  dealing  with  statistical  random  processes, 

1.   Probability  density 

A  random  time  variable  cannot  be  represented  in  the  form  of  explicit 
equation  which  is  valid  over  an  extended  period  of  time.   However,  the 
randomly  varying  quantity  can  be  described  by  various  statistical  relation- 
ships.  Basic  among-  these  is  the  probability  function. 

There  are  several  ways  to  define  the  probability  function.   One  of  them 

is  the  relative  frequency  definition.   In  a  random  experiment,  a  random 

variable  is  defined  as  a  single  valued  function  £  that  associates  a  distinct 

number  with  each  possible  outcomes  of  the  experiment.   If  an  experiment  is 

repeated  n  times  and  if  the  event  that  the  random  variable  ^  assumes  values 

between  a  and  b  occurs  n  times,  then  the  probability  of  this  event  can  be 

a 

defined  as 


n 
prob.  (a<^<b)  «=  lim  -4  (1) 

n->oo  n 


In  order  to  apply  statistical  methods  conveniently  to  continuous  func- 
tions, the  probability  that  a  particular  event  occurs  is  usually  given  in 
terms  of  a  function  called  the  probability  density,  Pg (x) , 


b 


prob.  (a<  J<  b) 


P.(x)  dx.  (2) 

a 


When  the  probabilitj'  density  is  known,  the  mean  value  of  the  random  variable 


is 


xp_  (x)  dx 

3 


(3) 


and  the  mean  square  value  of  the  random  variable  ?   is 


f1 
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x  Pte(x)  dx. 


(4) 


In  the  random  time  function  x(t),  the  random  variable  £■  represents  the 
amplitude  of  the  waveform  at  some  time  t.   Then,  Prob.  (x<£<  x-hdx) 
«=  P^  (x)dx  is  the  probability  that  the  amplitude  of  a  particular  waveform 
falls  in  the  interval  x<  £<  x-xix  at  time  t.   If  the  probability  density  of 
the  amplitude  of  an  ensemble  is  independent  of  time,  the  ensemble  is  said  to 
be  stationary.   7or  the  stationary  random  process,  the  ergodic  hypothesis 
states  that  these  ensemble  averages  are  the  same  as  the  corresponding  time 
averages,  taken  over  an  infinite  period,  of  a  single  sample  function.   That 
is 
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xP^(x)  dx  =  lim   — 
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'-T 


x(t)  dt 


r  °°  f 

2  ^ 

x  Pf;(x)  dx  =  lim   — 

f         T-^oo  2T 

J    -CO  /  m  -n 
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2(t)  dt 


(5) 


(6) 


2.   Normal  Distribution  Function 


oneral  mathematical  expression  for  a  normal  probability  density 


[x)  -  -zzr- 
5       y/2  7T<T 


exp 


—  2   _ 

(x  -  5 ) 


lT 
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(7) 


where  £  is  the  standard  deviation  \>hich  is  defined  as  the  square  root  of 


?\2 


variance  (£-£)   and  ?  is  the  mean  value  as  given  in  equation  (2), 
If  £  equal  zero,  equation  (7)  changes  into  the  form 


Pf(x) 


^■mr 


exp 


X 


2  -, 


2<r 


(8) 


A  graph  of  equation  (8)  is  shown  in  Figure  1.   The  integral  in  equation  (2) 
corresponds  to  the  shaded  area.   Since  the  normal  probability  density  is 
completely  described  by  the  standard  deviation  and  the  mean,  it  is  a  very 
convenient  function  with  which  to  work.   Many  random  quantities  encountered 
in  control  problems  have  probability  densities  that  may  be  considered  normal 
densities. 


P«(x) 
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Figure  1.   Probability  density  in  normal  dis- 
tribution with  zero  mean. 


3.   Correlation  Functions 

A  further  refinement  in  describing  the  statistical  characteristic; 
of  a  random  function  is  the  autocorrelation  function 


<j>ff(« 


lira   — 
T-*oo  2T 


f(t)  f(tv?)  dt 


(9) 


-T 


The  autocorrelation  function  gives  some  measurement  of  the  extent  to  which 
a  future  value  of  a  quantity  depends  on  the  present  value.   It  is  important 
to  note  that  by  setting  •£•  equal  zero,  equation  (9)  gives  the  mean  square 
value  of  the  random  quantity 


(i>  ff  (o) 


nm 
T-*  oo 


2T 


f  (t)  dt 


f(t)2 


(10) 


J   mr 


The  crosscorrelation  function  results  when  two  different  functions  are 
multiplied  in  an  expression  identical  in  form  to  equation  (9) 


lim   — 
T-*co  2T 


f(t)  g(t+f)  dt 


(11) 
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4.   Power  Density  Spectrum 


The  random  waveform  that  has  been  described  thus  far  in  terms  of  its 
time  variable  may  also  described  in  terms  of  its  frequency  spectrum.   (This 
is  strictly  true  only  for  random  functions  which  do  not  change  their  statis- 
tical  characteristics  with  time.)  A  useful  function  for  this  purpose  is 


the  power  density  spectrum 


$ffW 


2TT 
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where 


tff^ 
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ff 


(u»£ji^ 


dtO 


(13) 


A  linear  stable  system  of  gain  H(tO)  with  an  input  power  density  spectrum 
^^(iO)  will  have  an  output  power  density 
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fo(t)    fQ(t+7-)   dt      (14) 
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Figure  2.   Linear  system  relationship. 


Expressing  the  input  f .  (t)  and  f  (t)  of  linear  system  with  unit  impulse 


response  h(t)  by  a  convolution  integral 


f  (t)  = 

o 


h(i»   f.(t   -i>)  dp 


(15) 


Substituting  equation    (15)    into    (14),    there   results 


$oo(w) 


-  &*1   dr-    lim      JL 
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h(j?)   fj(t   -D)  di? 


-T  '  -<» 


h(<r)  f.  (t  +  f  -<r)  d<r 


(16) 


by  inversion  of  the  order  of  integration,  equation  (16)  becomes 
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(17) 


With  the  change  of  variable /<«=£*>'-#"  followed  by  separation  of  variables, 
equation  (17)  becomes 
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By  summing  the  power  density  spectrum  over  the  entire  range  of  frequencies, 
the  mean  square  value  of  the  random  variable  is  obtained 


4>ff(0)  =       $  ff(a>)  da; 


(19) 


5.   Cross  Power  Density  Spectrum 

Another  useful  function  of  a  random  waveform  that  may  be  described  in 
terms  of  frequency  spectrum  is  the  cross  power  density  spectrum 


$f«<*» 


1  ( 
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where 
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tfg(n  "      Jfg^  e   di° 


(21) 
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A  linear  stable  system  of  gain  HCo),  with  input  f . (t)  and  output 
f  (t),  has  the  input-output  cross-correlation  function 


<L<« 


lim   — 


f.(t)  fQ(t  +  fr)  dt 


(22) 


'  -r. 


To  bring  the  system  unit  impulse  response  into  this  expression  f  (t+?)  can 
be  expressed  by  the  convolution  integral 


f  (t  +t) 
o 


h<i?)  .  f.(t  +r-;o  ^ 


(23) 


Substituting  equation  (23)  into  (22),  results  in 
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f.  (t)   dt 
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h0>)   fj(t   +t  -V)  di? 
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h(y)  dp  lim 
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2T 


).x 


l.  it)  f.  (t  +  ?  -«))  dt 

i  1 


h(»)4>..(T-V>)   dp 

'      *1    "i 


(24) 


Equation  (24)  shows  that  the  input-output  crosscorrelation  of  a  linear 
system  is  the  convolution  of  the  unit  impulse  response  and  the  input  auto- 
correlation function. 

This  important  relation  can  also  be  expressed  in  the  frequency  domain 
by  a  transformation 


1  (  °° 

X  -CO 
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(25) 


With  Che  change  of  variable,  (T^T-l?*     equation  (25)  becomes 
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6.   Graphical  Determination  of  Autocorrelation  Function 

The  calculation  of  the  approximate  autocrosselation  curve  from  ex- 
perimental data  is  frequently  desirable.   To  reduce  equation  (9)  to  one 
requiring  only  discrete  operations,  f  is  divided  into  N  equally  spaced 
small  intervals  as  shown  in  Figure  3,  such  that  each  division  corresponds 
to  — -  seconds,  if  t  is  in  seconds.   The  curve  f (t*£l)  is  f(t)  displaced  m 
divisions  to  the  left,  corresponding  to  a  shift  of  ^jn=m(2T/N)  seconds.   At 
a  point  n  divisions  n(2T/N)  seconds  from  the  origin  of  f (t),  the  value  of 


12 


the 


curve  is  x^  and  the  value  of  f  (t+Z^)  is  x   .   The  approximate  expres- 


sion for  (9)  at  discrete  values  £  of  2:   is  therefore 

m 


t 


n-m 


tt  m 


N  +  1   n«=o 


^>    xx 

* —   n  n-Wn 


(27) 


7rm=m(2T/M) 


(2T) 


Figure  3.   Graphical  determination  of  autocorrelation  curve. 
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;ar  system  des 

When  a  nonlinear  system  is  subjected  to  random  inputs  with  known 
probability  density  functions,  soma  techniques  of  determining  describing 
function  should  be  investigated.   This  chapter  states  briefly  how  the  non- 
linear describing  functions  can  be  determined. 

1.   General  Description  of  Booton's  Mathod.   (ref.  I) 

The  effect  of  nonlinear  elements  on  stationary  random  input  signals  has 
been  investigated  in  recent  years  by  a  number  of  researchers.   Moreover, 
R.  C.  Booton  and  others  have  developed  methods  of  analysis  directly  appli- 
cable to  control  system  design.   The  Booton  method  characterizes  the  nonlinear 
elements  by  a  describing  function. 

Using  Booton fs  method,  one  finds  an  equivalent  gain  function  for  a 
nonlinear  device  by  comparing  its  actual  output  with  the  output  of  an  equiva- 
lent gain  function.   The  chosen  value  for  the  equivalent  gain  is  that  which 
minimizes  the  rms  difference  between  the  two  outputs. 


x(t) 

Gn 

y(t) 

c 

x(t) 

s 

P^(x) 

) 

H 

x(t) 

J 

iiX(t) 

e<t) 


Figure  4.   Booton's  method. 
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In  Figure  4,  ^V(x)  is  input  probability  density,  G   is  a  nonlinear 
function,  H  is  an  equivalent  gain,  and  e  is  the  difference  between  the 
actual  gain  and  equivalent  gain  output. 
From  Figure  4 


e(t)  -  y(t)  -  Hx(t) 


(28) 


By  squaring  both  sides  of  equation  (28),  there  is  obtained 


e2(t)  -  y2(t)  -  2y(t)  Kx(t)  +  (Hx(t))2 


(29) 


thus  ,  the  mean  square  value  of  e(t)  is 


e2(t)  ■»  lim 


T^-oo 
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e  (t)  dt 


/-T 
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LI 

2T  \ 


-X 


y2(t)  dt  -  2H      y(t)  x(t)  dt 


+  H 


xz(t)  dt 


/-T 


} 


2     2  ? 

r  -  2Hyx  +  H  x^ 


(30) 


The  desired  value  of  H  is  the  one  which  minimizes  e  (t),  since 


de 


dH 


-2yx  +  2Kx2 


(31) 


therefore,  the  desire  equivalent  gain,  H,  is 
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H  -  — w~  .  (32) 

x 


Since  both  y(t)  and  x(t)  are  assumad  to  be  random  functions  of  one  sort  or 
another,  the  time  average  of  equation  (5)  can  be  put  into  terms  of  proba- 
cy ch.        :.cs  if  y(t)  and  x(t)  are  stat     •  processes.  When  the 
processes  are  ergodic,  the  ensemble  average  of  the  variables  will  be  equal 
to  time  average.   From  equation  (6),  the  ensemble  average  of  x2  is 


x2  - 


x2?c(x)  dx  (33) 


To  find  the  average  of  yx,  assume  that  the  actual  transfer  characteristic  of 
the  nonlinear  element  is  such  that  the  output  is  a  single  valued  function  of 
the  input,  that  is,    y(t)  =  f  [x(t)J  ,   therefore 


yx  = 


I   °° 


/  -co 


xf(x)  P~(x)  dx  (34) 


Upon  substituting  equation  (33)  and  (34)  into  equation  (32),  there  results 

f  °° 


xf(x)  ??(x)  dx 


-00 


H  . (35) 


00 


x2P^(x)  dx 
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2.   Describing  Function  For  Simple  Isolated  Nonlinear  Elements. 

When  the  random  input  describing  function  for  isolated,  simple 
nonlinear it ies  is  a  pure  gain  H,  then,  by  equation  (35),  the  describing 
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function  can  be  determined  when  the  probability  density  of  input  is  known. 
Several  nonlinearit ies  will  be  discussed  here  before  proceeding  to  the 
more  general  case, 
a.   Limiting  (ref,  2) 


a 



A 

X 

/ 

/ 

y 

zz 

0 
-a 

Figure  5.   Input  putput  relation  of  simple  nonlinearity. 


In  Figure  5,  is  a  time  function  with  a  normal  amplitude  distribution 
of  zero  mean,  so  that 

.2 

(36) 
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P~(x) 

> 

~     2  0* 

(TsJ  2  IT 

where  (T  is  the  standard  deviation. 
The  output  y(t)  is 


y(t)  -  -a  ;     as  x  < -a 

■  x  ;      as  -a<  x  <  a 
=  a  ;      as  x>  a 


(37) 


From  equation  (35),  there  is 
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Since   the    integrand    is   an  even  function  of  x 
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then, 
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Upon  combining  the  results  there  is  obtained 
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The  normal  input,  pure  gain  describing  function  for  limiting  is,  there- 


fore, 
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b.   Sgn  function  (ref.  2) 


:; 
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0 
-a 

Figure  6.   input  output  relation  of  simple  nonlinearity. 

Let  x  represents  a  time  function  with  a  normal  amplitude  distribution  of 
zero  mean,  so  that 
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The  output  y(t)  is 
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From  equation  (35) 
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where 
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Upon  combining  these  results,  there  results 
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3.   Threshold  (ref.  2) 
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Figure  7.   Input  output  relation  of  simple  nonlinear ity. 
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In  Figure  7,  x  is  a  time  function  with  a  normal  amplitude  distribution 
of  zero  mean,  so  that 
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The  output  y(t)  is 
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From  equation  (35) 
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where 
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From  equation  (40)  there  is 
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Substituting  equation    (56)    into    (52),   there  results 
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3.   Generalization  of  Isolated  Nonlinear  Element. 

The  basic  concept  of  the  statistical  describing  function  has  been 
explored  for  simple  examples.   The  generalization  of  these  procedures  that 
leads  to  a  linear  equivalent  system  that  is  not  restricted  to  a  pure  gain 
is  derived  as  follows: 

If  the  nonlinear  element  is  approximated  by  some  linear  weighting 
function  h(^).   The  error  in  approximation  is  then, 


/  oo 
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Taking  the  mean  value  of  of  equation  (59),  there  is 
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interchanging  the  order  of  integration,  equation  (60)  becomes 
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Substituting  equation  (62)  into  (61),  there  results 
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Applying  the  calculus  of  variations,  the  weighting  function  h(T)   will  be 
set  equal  to  w(f)  +Az(t),  where  w(xO  is  the  optimum  weighting  function,  A 
is  the  small  multiplier  independent  of f  ,  and  z (^)  is  a  dif ferentiable  func< 
tion  of  '£,      Equation  (63),  then,  becomes 
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Differentiating  equation  (64)  with  respect  to  A,  and  setting  the  expression 
equal  to  zero,  equation  (64)  becomes 
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Setting,A.<=0,  equation    (65)   becomes 
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..acing  w(?0   by  h(u),  equation    (67)   becomes 


i    (r) 

I  vv 


/  CO 


'xy 


; 


h(u)<b      (T-  u)du 


k68; 


The  result  of  equation  (63)  has  shown  that  the  input-output  crosscorrela- 
tion  of  the  best  linear  equivalent  system  is  cue  convolution  of  the  linear 
equivalent  weighting  function  and  the  input  autocorrelation. 

This  important  relationship  can  be  transformed  into  frequency  domain 
:rom  equation  (24)  to  (26),  therefore, 
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Figure  8.   Isolated  nonlinear  element  with  a  random  input. 


23 


4.   Another  Mathod  of  Determining  Random  Input  Dascribir.     ction 

Another  method  of  defining  t^Q   random  input  describing  function  has 
.ested  by  N.  P.  Pastel,  (ref,  2)   Passing  a  random  signal  throu 
onlinear  device  changes  its  probability  distribution.   For  example, 
Fi  ure  10  shows  the  alteration  of  the  probability  distribution  in  a  particu- 
lar case,  where  the  nonlinear  element  is  a  saturating  amplifier.   The  ampli- 
fier is  linear  with  gain  K  for  output  signal  amplitudes  between  *a.   The 
saturating  phenomenon  can  be  represented  by  a  linear  amplifier  followed  by 
a  limiter.   This  is  shown  in  Figure  9a  and  9b. 

Assume  a  normally  distributed  input  signal,  x,  passes  through  the  satu- 
rating amplifier.   Since  the  linear  amplifier  does  not  change  the  form  of 
distribution,  the  output  of  linear  amplifier,  x,  will  have  the  probability 
density  as  shown  in  Figure  10a.   When  this  signal  is  passed  through  the 
limiter,  the  distribution  remains  unchanged  between  JT  a.   But  the  output  can- 
not exceed  £  a,  and  thus  the  probability  of  obtaining  an  output  with  absolute 
magintude  greater  than  a  is  zero.   On  the  other  hand,  all  of  the  large  input 
. -  ;nals  cause  a  saturated  output,  so  the  probability  of  obtaining  an  output 
of  amplitude  -{-a (or  -a)  is  greatly  increased,  and  must  be  equal  to  the  aroa 
under  the  input  probability  curve  from  va(or  -<*>)  to  -/<x>(or  -a).   This  output 
condition  is  represented  on  the  probability  curve  as  a  pair  of  vertical  lines, 
or  impulses  at  equal  to + a. 

The  area  under  the  output  distribution  curve  is  indicated  in  Figure 
10b,   Thus  the  total  area  under  the  output  distribution  curve  is  unity  as 
required  for  a  probability  dendity  function.   Figure  11  shows  output  proba- 
bility density  functions  for  limiting,  sgn,  and  threshald  function. 
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Figure  9a.   Saturation  amplifier  response. 

b.   Equivalent  system  of  saturating  amplifier. 
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Figure  10a.   Input  probability  density. 

b.   Output  probability  density  of  a  limiter 
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Figure  11.   Distribution  function  for  cordon  nonlinearities. 
(ref.  3) 


■y?. 


In  practical  applications  only  normally  distributed  inputs  arc  usually 
considered,  for  they  remain  normally  distributed  when  passed  through  a  linear 
network  or  when  added  to  another  normally  distributed  random  signal. 

Assuming  a  normally  distributed  input  with  zero  mean  passed  through  some 
simple  nonlinear it ies,  the  procedure  for  evaluating  the  statistical  describing 
function  is  illustrated  below, 
a.   Limiting 

As  in  Fig.  5,  x  represents  an  input  time  function  with  a  normal  amplitude 
distribution  of  zero  mean,  and  y  is  the  time  function  of  tne  output.   Then, 
referring  to  Figure  11a,  the  variance  or  the  mean  square  value  of  the  out- 
put distribution  is  seen  to  be 
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Substituting  equation  (72)  into  (71),  yields 
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Using  integration  by  parts,  equation  (73)  becomes 
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then,  equation  (74)  becomes 
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Inserting  numerical  values  into  equation  (75)  and  (76)  and  taking  the  square 
root  of  equation  (76),  the  statistical  describing  function  is 


Ha  -  -JL  (77) 


Equation  (77)  is  plotted  in  graphical  form  as  shown  in  Figure  12.   In  order 
to  compare  the  tvro  methods  mentioned  so  far,  a  curve  of  H  as  given  by  equation 
(43)  is  also  shown  in  Figure  12. 
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Figure  12.   Value  of  describing  function  for  simple 
limiter  with  normal  distribution  input. 


b.   Sgn  function 

As  in  Figure  6,  x  is  an  input  time  function  with  a  normal  amplitude 
distribution  of  zero  mean,  and  y  is  the  output  time  function.   Referring  co 
/.   :ure  lib,  the  variance  of  the  output  distribution  is  seen  to  be 
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re  13.   Value  of  describing  function  for  sgn 

function  with  norinal  distribution  input. 

c.      ihold 

In  Figure?,  x  represents  an  input  time  function,  laving  normal  distribu- 
-  l  of  zero  .  san,  and  y  is  the  output  1     .unction.   From  Figure  lie,  the 
varia  .cq   of  the  output  distrioution  is  found  to  be 
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where  A  is  the  same  as  equation  (75). 


Inserting  numerical  values  and  taking  the  square  root  of  equation  (82),  the 


statistical  describing  function  is 
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.  .cal  form  of  equation  (33)  and  (57)  are  plotted  on  Figure  14. 
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Figure  14.   Value  of  describing  function  for  a  threhold  non- 
linearity  with  normal  distribution  input. 
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THE  ANALYSIS  OF   CLOSED  LOOP  SYSTEM 

Because  the  presence  of  a  nonlinear  element  in  the  system  destroys 
the  normally  distributed  nature  of  the  signals,  the  input  signal  to  the 
nonlinear  device  cannot  be  a  normal  distribution  in  a  feedback  system.   How- 
ever, it  has  been  shown  (ref.  4)  that  a  relatively  low  system  bandwidth 
tends  to  redistribute  the  signals  into  a  normal  form.   Thus  it  is  a  practi- 
cal engineering  assumption  to  consider  the  return  signal  to  the  input  of  the 
nonlinear  element  as  normally  distributed.   This  assumption  permits  analysis 
of  feedback  systems  in  the  same  manner  as  the  open  loop  examples  given  above, 
This  chapter  deals  with  two  different  methods  of  analyzing  closed  loop  non- 
linear systems. 

1.   Correlation  Function  Method 

For  the  case  of  the  isolated  element  shown  in  Figure  8,  the  random 
input  discribing  function  according  to  equation  (70)  is 

I      («3) 

H(to)  -  ~^- (84) 

For  the  prototype  closed  loop  control  system  of  Figure  15,  the  descri- 
bing function,  H,'  represents  the  nonlinear  element,  while  G(«;)  describes 
the  performence  of  the  linear  constant-parameter  elements  of  the  system. 

From  Figure  15,  the  signals  within  the  system  expressed  in  the  fre- 
quency domain  are 
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Figure  15.   Prototype  closed  loop  control  system 
with  random  input. 


Now  according  to  equation  (26) 
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Once  the  power  density  spectrum  and  crosspower  density  spectrum  are  deter- 
mined, the  random  input  describing  function  can  also  be  determined  from 
equations  (93)  to  equation  (95), 

2.   Graphical  Method 

Another  method  of  obtaining  the  random  input  describing  function  for  a 
nonlinear  element  is  described  by  M.  P.  Pastel,  (ref,  3)   When  a  nonlinear 
device  is  a  component  in  a  feed-back  control  system,  its  input  is  a  function 
not  only  of  the  system  command  signal  but  also  of  the  signals  feedback 
around  it.   It  would  then  seem  that  the  describing  function  itself  must  be 
known  to  the  input  signal.   Fortunately,  two  simultaneous  equations  which 
contain  the  describing  function  and  its  input  as  the  unknown  can  be  developed. 
The  first  is  written  from  conventional  feedback  system  equations  using  the 
given  power  density  spectrum  as  the  system  input  and  stating  the  describing 
function  as  an  unknown  parameter.   The  second  is  generated  graphically, 
such  as  in  Figure  12  (for  the  case  of  simple  limiter),  from  the  output  dis- 
tribution form  of  describing  function,   A  plot  of  the  first  equation  on  the 
graph  of  the  second  will  then  give  the  solution  for  the  value  of  the 


describing  function  at  the  intersection  of  the  two  curves.   This  procech 
is  illustrated  by  a  simple  o>:>.        vj. 
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Figure  16a.   Nonlinear  servo  system, 

b.   System  in  a  form  for  statistical  analysis. 

The  position  servo  in  Figure  16a  contains  a  saturating  element,  and 

is  subjected  to  a  random  input  with  normal  distribution  and  power  density 

spectrum  ^p,(o3).  The  first  step  in  the  analysis  is  shown  in  Figure  16b,  in 

T..-,lch  the  limiter  has  been  replaced  by  its  describing  function  K  .   From 


Figure  16a  there  is  obtained 
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C(s) 
R(s) 


C(s) 

T(sT 


s  +  5ri 


a 


where  the  limiter  is  replaced  by  its  describing  function  H  . 
Therefore,  the  input  to  limiter  Y(s)  as  shown  in  Figure  16a  is 


5s 

Y(s)  =  5£(s)  <= R(s) 

s  +  5H_ 


(96) 


If  the  input  signal  has  a  power  density  spectrum  of 


P*    I  +UJ2 


(97) 


then  the  power  density  spectrum  at  the  input  to  the  limiter  is 
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(W-  jl)(<0  +  ji)(«0-  j5iia)(^U  +  j5l 


The  first  relationship  between  the  rms  value  of  the  input  to  the  limiter  and 
the  describing  function  is  then 
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Upon  taking  the  square  root  of  equation  (99),  there  results 


17.7 


a  = 


y    \/l  +  5H_ 


(100) 


The  second  relationship  between  a     and  H  is  given  by  the  curve  in  Figure  12, 
with  the  saturation  value  of  the  limiter  defined  as  "a"  equals  2.5.   Figure 
17  is  the  same  as  Figure  12  with  curve  added  for  the  function  of  equation 
(100)  divided  by  2.5.   The  intersection  of  this  two  curves  provides  the 
simultaneous  solution  of  the  equations.   Hence  for  this  case,  the  value  of 
a  ■  1.825  and  the  value  of  H.  is  0,88.   The  value  of  the  rms  error  signal  cf 
is  then  0.365. 


0.88c- 
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0.2 


Equation  (77) 


\  Equation  (100) 


0.5  0.73  1.0 
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^:o 
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Figure  17.   Graphical  solution  for  describing  function 
and  rms  value  of  the  input  to  limiter  in 
Figure  16. 
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ANA  .YSIS  OF  Jl 

jeresting  example  of  using  the  normal  random  input  describing 
function  i::  the  jump  resonance  phenomenon,  (ref.  2)   In  Figure  18  is  shown 
a  servomechanism  with  a  saturating  amplifi. 


Kt)-;-^  e(t) 
-® 


_  i  • 


Figure  18.   Block  diagram  of  a  servomechanism 
with  a  saturating  amplifier. 


If  one  supposes  that  the  input  possesses  a  normal  amplitude  probability 
distribution  and  a  power  spectral  density  which  is  the  equivalent  of  the  one 
obtained  when  white  noise  is  passed  through  a  first  order  lag-filter,  then, 
according  to  equation  (18) 


$H<w>  «|H<w>l2$kkotf 


(101) 


R 


vhite  noise 


: 


*!<<"»'  ' 


c  ; 


1, 


Figure  19.   Input  output  relation  of  first  order  lag-filter. 


From  Figure  19,  the  transfer  function  H(w)  is 


thus 


;:(w)  -  — l 
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oO- 


jRCtf  v  1 


ju>C 


iu> 


i 

RC 


J      1 


(102) 


H(w>) 


W  \ 


a)2  +  U>i2 


(103) 


re  CO  . «= —  which  is  the  break  frequency  of  the  first  order  lag-filter. 
Upon  substituting  equation  (103)  into  (101),  there  is  obtained 


1   (u>)  =  k 


uJ 


a>2  *u)-2 


(104) 


Under  the  assumption  that  the  input  to  the  limiter  is  a  stationary  normal 
input,  the  limiter  characteristic  is  replaced  by  its  first  approximation  equiva. 

lent.   According  to  equation  (43)  it  holds  that   H  =  — - —  {  "vi   e"   dz , 

2iT  Jo 

in  which  !l  is  the  variance  sensitive  pure  gain.   The  closed  loop  error  input 
transfer  function  is  then  given  by 
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E(s) 
I(s) 
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(105) 


The   power  spectral  density  of   the   error,   e(t),    is 
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(106) 
The  ir.ean  square  value  of   the  error,   according   to  equation    (l0)   and    (13),    is 


e2(t)   -  Jff(0)   -  Jee(o)dtO=I  |ee(w)dW 
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KU>; 
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(107) 


Equation  (107)  may  be  identified  with  integrals  of  the  general  form  of 

i     r       ex) 


where 


n    2^       L*  hn<x)  ^(-x) 
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h  (x)  -  a  x   v  a,x    +  •••  +  a„ 

n       o      i  n 


g  (x)  "ox     v  b,x     v  •••  +  b   , 
n      o        1  n-1 


An  abbreviated  table  of  these  integral  is  presented  in  the  appendix;   In 
present  case 

4  2 
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From  table    in  the   appendix 
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-stituting  the  appr            te  values   for  the  constants, 
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(112) 

z              (  JE  +eo.   +  i  ) 

r«3.       x     t 

Now  the  mean  square  value   of  the   input    is 
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kTTtll 
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therefore, 

1 

-5 —    -5 —    HK  +<0.  +  - 

eZ(t)  -  i"(t)  — I ^—  (il4) 

1 

The  mean  square  value  (here  it  is  equal  to  variance)  of  the  input  to  the 
limiter  is  related  to  the  ir.ean  square  value  of  the  system  error  signal  by 
the  expression 


2    2    2 

a     «»  K  •  e 


.  K   •  i    --; 5-  (115) 
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The  characteristic  equation  of  linear  system  (H^l)  is 

2        'l  K  2 
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where 
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Upon  substituting  equation  (117)  into  (115),  there  results 
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h  +  4?  t/y.  a  +m)  ]  0 

7  1  j.  Z 
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(119) 


:.:: 


then, 
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;i20) 


Recalling  that  H  is  a  function  of  — ,  it  is  to  be  expected  that  there  will  be 

J 
2  2 

more  than  one  value  of  e   for  any  given  value  of  i   if  tne  condition 


dJ       d    .    -  H  +  Tx\qL  ,  s 

d(i)    d(S)  t  l  h  +dC   J °  ) 


is  met.   The  possible  multivalued  relationship  between  the  input  signal  and 


the  error  signal  is  the  source  of  jump  phenomenon.   The  establish t  of  t 

necessary  conditions  for  the  jump  phenomenon  directly  from  considerations  of 
the  circumstances  under  which  the  expression  for  the  derivative  may  be  zero 
proceeds  as  follows, 
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Equation  (121)  may  be  reexpressed  as 
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Because     —  4s   0,   therefore, 
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Equation  (124)  may  be  solved  graphically  by  plotting  the  left  and  right 

.  sices  of  the  equation  against  -*   Where  there  are  intersections  of  the 

a 

two  curves  in  the  plot^  equation  (124)  is  satisfied  and  the  feet  that  the 
conditions  for  the  jump  phenomenon  exist  have  been  established. 

If,  in  connection  with  the  same  system,  the  input  is  now  changed  so  c'r.cz 
it  is  equivalent  to  white  noise  passed  through  a  second  order  lag  filter, 
transfer  function  from  Figure  20  is 
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Figure  20.   Input  output  relation  of  second 
order  lag  filter. 
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The. power  spectral  density  of  the  error,  e(t),  is 
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mean  square  value  of  the  error  signal  is  then 
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where 
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From  table   in  appendix: 
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substituting  the  appropriate  values  for  the  constants,  there  results 
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.  mean  square  value  of  the  error  is5  then, 
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From  table    in  appendix: 
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substituting   the  appropriate  values   for  the  constants,   there    is   obtained 
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Upon  si       tituting  equation    (135)    into    (131)   there    is   obtained 
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The  mean  square  value  of  the  input  to  the  limiter  is  related  to  the  mean 
square  value  of  the  system  error  signal  by  the  expression 
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Equation  (138)  is  plotted  or.  Fi  ;ure  21,  in  terms  of  the  relationship  be- 

tween  a  and  i  .  accuse   the  values  of  H  in  equation  (138)  itself  is  a 

~~ 2 
ction  of  a,  one  can  find  the  corresponding  values  of  i   by  simply  as:, 

2 
some  values  of  O'  .   The  following  table  is  calculated  by  putting  a=l , 

(a  is  cha  value  that  saturating  amplifier  begin  to  saturate),  ^=0.1, 

?n-0.05. 

It  may  be  readily  observed  from  Figure  22,  in  certain  case,  there 

2  ~~2 

are  two  or  more  values  of  Q"  for  some  values  of  i  .   In  other  words,  there 

7  ~2 

are  two  or  more  values  of  e     corresponds  to  a  certain  value  of  i  .   This 

shows  the  condition  for  the  jump  phenomenon  with  random  input. 
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Table  1.   The  corresponding  values  of  Figure  22 
according  to  equation  (138). 
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Figure  21.   Performance  of  the  limiting  amplifier  servo- 
mechanism  exhibiting  the  jump  phenomenon. 
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CONCLUSION 

The  methods  of  analysis  in  this  report  are  restricted  co  the  simple 
nonlinear  devices  in  which  the  outputs  are  functions  of  the  instantaneous 
values  of  the  inputs,  i.e.,  the  c  svices  have  no      y  storing  properties. 

The  inputs  to  position  s  ha  saturatii   .  plifier  that 

a'A'r.:'c±zr>    the  jump  phenomenon  are  discussed  for  the  case  when  a  white  noise 
passes  the  first  and  the  second  order  lag-filter.   When  a  white  noise  passes 
through   .  her  order  lag-filter  the  analysis  becomes  rather  complicated.   It 
is  hoped  that  the  writer  may  have  a  chance  to  deal  with  this  case  in  the  nea: 
future. 
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are  are  a  number  of  methods  for  analyzing  the  effect  of  rand 

inputs  of  the  dynamic  error  of  control  systems  that  contain  nonlinear  ele- 
ments.  One  method  involves  replacement  of  the  nonlinear  ele 
system  by  an  equivalent  device  whose  desc.     \   function  characteristics  are 
functions  of  the  rms  signals  at  the  input  of  nonlinear  element, 

of  developing  statistical  describing  functions  are  given  in  this  report. 
One  of  them  uses  an  analytical  method  to  minimize  the  "system  error  signals. 
a  other  requires  the  dejcz     irion  of  the  output  probability  distribution 
of  the  nonlinear  device  and  defines  the  ratio  of  the  rms  value  of  the  ouc- 
put  to  input  distribution  as  the  statistical  describing  function.   2oth  of 
these  methods  are  applied  to  s     -   nonlinear  devices  in  which  the  output  is 
-  -junction  of  the  instantaneous  value  of  the  input. 

A  rather  interesting  example  of  jump  phenomenon  occurs  when  the  po- 
sition servomechanism  with  c   saturating  amplifier  is  subjected  to  a  particu- 
lar input  signal.   This  phenomenon  has  also  been  discussed. 

A  bri--  c-_ocussion  of  some  fundamental  statistical  techniques  is  also 
given  in  order  to  provide  the  supporting  background  for  the  development 
of  the  analysis. 


